2026-10-26 11:38:35,020 [ 126596 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-10-26 11:38:35,020 [ 126596 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-10-26 11:38:35,020 [ 126596 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-10-26 11:38:35,020 [ 126596 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_amvmrb --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=2 --color=no --durations=0 'test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3]' 'test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain]' test_backup_restore_s3/test.py::test_backup_to_s3 test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials test_backup_restore_s3/test.py::test_backup_to_s3_multipart test_backup_restore_s3/test.py::test_backup_to_s3_named_collection test_backup_restore_s3/test.py::test_backup_to_s3_native_copy test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_other_bucket test_backup_restore_s3/test.py::test_backup_to_tar test_backup_restore_s3/test.py::test_backup_to_tar_bz2 test_backup_restore_s3/test.py::test_backup_to_tar_gz test_backup_restore_s3/test.py::test_backup_to_tar_lzma test_backup_restore_s3/test.py::test_backup_to_tar_xz test_backup_restore_s3/test.py::test_backup_to_tar_zst test_backup_restore_s3/test.py::test_backup_to_zip 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True]' test_backup_restore_s3/test.py::test_incremental_backup_append_table_def test_backup_restore_s3/test.py::test_user_specific_auth -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: order-1.0.1, random-0.2, timeout-2.2.0, repeat-0.9.3, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False collecting ... collected 27 items test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] ERROR [ 3%] test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] ERROR [ 7%] test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local] ERROR [ 11%] test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3] ERROR [ 14%] test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain] ERROR [ 18%] test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local] ERROR [ 22%] test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain] ERROR [ 25%] test_backup_restore_s3/test.py::test_backup_to_s3 ERROR [ 29%] test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials ERROR [ 33%] test_backup_restore_s3/test.py::test_backup_to_s3_multipart ERROR [ 37%] test_backup_restore_s3/test.py::test_backup_to_s3_named_collection ERROR [ 40%] test_backup_restore_s3/test.py::test_backup_to_s3_native_copy ERROR [ 44%] test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart ERROR [ 48%] test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_other_bucket ERROR [ 51%] test_backup_restore_s3/test.py::test_backup_to_tar ERROR [ 55%] test_backup_restore_s3/test.py::test_backup_to_tar_bz2 ERROR [ 59%] test_backup_restore_s3/test.py::test_backup_to_tar_gz ERROR [ 62%] test_backup_restore_s3/test.py::test_backup_to_tar_lzma ERROR [ 66%] test_backup_restore_s3/test.py::test_backup_to_tar_xz ERROR [ 70%] test_backup_restore_s3/test.py::test_backup_to_tar_zst ERROR [ 74%] test_backup_restore_s3/test.py::test_backup_to_zip ERROR [ 77%] test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False] ERROR [ 81%] test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False] ERROR [ 85%] test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False] ERROR [ 88%] test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True] ERROR [ 92%] test_backup_restore_s3/test.py::test_incremental_backup_append_table_def ERROR [ 96%] test_backup_restore_s3/test.py::test_user_specific_auth ERROR [100%] ==================================== ERRORS ==================================== _ ERROR at setup of test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] __ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling node ... done Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 11:38:38 [ 452 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 11:38:38 [ 452 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 11:38:38 [ 452 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 11:38:38 [ 452 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 11:38:38 [ 452 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 11:38:38 [ 452 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 11:38:38 [ 452 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 11:38:38 [ 452 ] INFO : Running tests in /ClickHouse/tests/integration/test_backup_restore_s3/test.py (cluster.py:2659, start) 2026-10-26 11:38:38 [ 452 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 11:38:38 [ 452 ] DEBUG : Docker networks for project roottestbackuprestores3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 11:38:38 [ 452 ] DEBUG : Docker containers for project roottestbackuprestores3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 11:38:38 [ 452 ] DEBUG : Docker volumes for project roottestbackuprestores3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 11:38:38 [ 452 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 11:38:38 [ 452 ] DEBUG : Docker networks for project roottestbackuprestores3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 11:38:38 [ 452 ] DEBUG : Docker containers for project roottestbackuprestores3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 11:38:38 [ 452 ] DEBUG : Docker volumes for project roottestbackuprestores3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 11:38:38 [ 452 ] DEBUG : Command:docker container list --all --filter name='^/roottestbackuprestores3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 11:38:38 [ 452 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 11:38:38 [ 452 ] DEBUG : No running containers for project: roottestbackuprestores3 (cluster.py:829, cleanup) 2026-10-26 11:38:38 [ 452 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 11:38:38 [ 452 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 11:38:38 [ 452 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 11:38:38 [ 452 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 11:38:38 [ 452 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 11:38:38 [ 452 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 11:38:38 [ 452 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 11:38:38 [ 452 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 11:38:38 [ 452 ] DEBUG : Setup directory for instance: node (cluster.py:2679, start) 2026-10-26 11:38:38 [ 452 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 11:38:38 [ 452 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 11:38:38 [ 452 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 11:38:38 [ 452 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 11:38:38 [ 452 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_backup_restore_s3/configs/disk_s3.xml', '/ClickHouse/tests/integration/test_backup_restore_s3/configs/named_collection_s3_backups.xml', '/ClickHouse/tests/integration/test_backup_restore_s3/configs/s3_settings.xml', '/ClickHouse/tests/integration/test_backup_restore_s3/configs/blob_log.xml'] to /ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 11:38:38 [ 452 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/database (cluster.py:4488, create_dir) 2026-10-26 11:38:38 [ 452 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/logs (cluster.py:4499, create_dir) 2026-10-26 11:38:38 [ 452 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 11:38:38 [ 452 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:2993bc2bf171', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env (cluster.py:86, _create_env_file) 2026-10-26 11:38:38 [ 452 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 11:38:38 [ 452 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 11:38:38 [ 452 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 11:38:38 [ 452 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 11:38:38 [ 452 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 11:38:38 [ 452 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:39:42 [ 452 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 11:39:42 [ 452 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo2 ... Pulling zoo1 ... Pulling zoo3 ... Pulling node ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... done Pulling zoo3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 11:39:42 [ 452 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:40:36 [ 452 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 11:40:36 [ 452 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo1 ... Pulling zoo2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling zoo3 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 11:40:39 [ 452 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:41:32 [ 452 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 11:41:32 [ 452 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo2 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 11:41:38 [ 452 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:42:32 [ 452 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 11:42:32 [ 452 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo1 ... Pulling zoo3 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling node ... done Pulling zoo3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 11:42:41 [ 452 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 11:43:45 [ 452 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling node ... done Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 11:43:45 [ 452 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 11:43:45 [ 452 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 11:43:45 [ 452 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Docker networks for project roottestbackuprestores3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 11:43:45 [ 452 ] DEBUG : Docker containers for project roottestbackuprestores3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 11:43:45 [ 452 ] DEBUG : Docker volumes for project roottestbackuprestores3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 11:43:45 [ 452 ] DEBUG : Command:docker container list --all --filter name='^/roottestbackuprestores3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : No running containers for project: roottestbackuprestores3 (cluster.py:829, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 11:43:45 [ 452 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 11:43:45 [ 452 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Docker networks for project roottestbackuprestores3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 11:43:45 [ 452 ] DEBUG : Docker containers for project roottestbackuprestores3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 11:43:45 [ 452 ] DEBUG : Docker volumes for project roottestbackuprestores3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 11:43:45 [ 452 ] DEBUG : Command:docker container list --all --filter name='^/roottestbackuprestores3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : No running containers for project: roottestbackuprestores3 (cluster.py:829, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 11:43:45 [ 452 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 11:43:45 [ 452 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _ ERROR at setup of test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] _ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_backup_to_disk[from_local_to_local] __________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_backup_to_disk[from_local_to_s3] ____________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_backup_to_disk[from_local_to_s3_plain] _________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_backup_to_disk[from_s3_to_local] ____________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_backup_to_disk[from_s3_to_s3_plain] __________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________________ ERROR at setup of test_backup_to_s3 ______________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_backup_to_s3_different_credentials ___________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_backup_to_s3_multipart _________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_backup_to_s3_named_collection _____________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_backup_to_s3_native_copy ________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_backup_to_s3_native_copy_multipart ___________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_backup_to_s3_native_copy_other_bucket _________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________________ ERROR at setup of test_backup_to_tar _____________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_backup_to_tar_bz2 ___________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_backup_to_tar_gz ____________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________________ ERROR at setup of test_backup_to_tar_lzma ___________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_backup_to_tar_xz ____________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_backup_to_tar_zst ___________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________________ ERROR at setup of test_backup_to_zip _____________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_backup_with_fs_cache[False-True-False] _________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_backup_with_fs_cache[True-False-False] _________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_backup_with_fs_cache[True-True-False] _________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_backup_with_fs_cache[True-True-True] __________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_incremental_backup_append_table_def __________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________________ ERROR at setup of test_user_specific_auth ___________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_backup_restore_s3/test.py:144: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling node ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ============================== slowest durations =============================== 307.89s setup test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] 0.00s teardown test_backup_restore_s3/test.py::test_user_specific_auth 0.00s teardown test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_xz 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_zip 0.00s teardown test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3 0.00s teardown test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_named_collection 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_zst 0.00s teardown test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False] 0.00s teardown test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_multipart 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_gz 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_lzma 0.00s teardown test_backup_restore_s3/test.py::test_incremental_backup_append_table_def 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_native_copy 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_tar_bz2 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_other_bucket 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart 0.00s teardown test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] 0.00s setup test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] 0.00s teardown test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar 0.00s setup test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_zip 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_other_bucket 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_xz 0.00s setup test_backup_restore_s3/test.py::test_incremental_backup_append_table_def 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart 0.00s setup test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_zst 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_named_collection 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3] 0.00s setup test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True] 0.00s setup test_backup_restore_s3/test.py::test_user_specific_auth 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_lzma 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain] 0.00s setup test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_native_copy 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_bz2 0.00s setup test_backup_restore_s3/test.py::test_backup_to_tar_gz 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials 0.00s setup test_backup_restore_s3/test.py::test_backup_to_s3_multipart 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain] 0.00s setup test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local] =========================== short test summary info ============================ ERROR test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3] ERROR test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local] ERROR test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain] ERROR test_backup_restore_s3/test.py::test_backup_to_s3 - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials ERROR test_backup_restore_s3/test.py::test_backup_to_s3_multipart - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_s3_named_collection - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart ERROR test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_other_bucket ERROR test_backup_restore_s3/test.py::test_backup_to_tar - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_bz2 - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_gz - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_lzma - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_xz - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_tar_zst - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_to_zip - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False] ERROR test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True] ERROR test_backup_restore_s3/test.py::test_incremental_backup_append_table_def ERROR test_backup_restore_s3/test.py::test_user_specific_auth - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/.env', '--project-name', 'roottestbackuprestores3', '--file', '/ClickHouse/tests/integration/test_backup_restore_s3/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ======================== 27 errors in 310.27s (0:05:10) ======================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 437, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_amvmrb --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=2 --color=no --durations=0 'test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3]' 'test_backup_restore_s3/test.py::test_backup_from_s3_to_s3_disk_native_copy[from_s3_to_s3_other_bucket]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_local]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_local_to_s3_plain]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_local]' 'test_backup_restore_s3/test.py::test_backup_to_disk[from_s3_to_s3_plain]' test_backup_restore_s3/test.py::test_backup_to_s3 test_backup_restore_s3/test.py::test_backup_to_s3_different_credentials test_backup_restore_s3/test.py::test_backup_to_s3_multipart test_backup_restore_s3/test.py::test_backup_to_s3_named_collection test_backup_restore_s3/test.py::test_backup_to_s3_native_copy test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_multipart test_backup_restore_s3/test.py::test_backup_to_s3_native_copy_other_bucket test_backup_restore_s3/test.py::test_backup_to_tar test_backup_restore_s3/test.py::test_backup_to_tar_bz2 test_backup_restore_s3/test.py::test_backup_to_tar_gz test_backup_restore_s3/test.py::test_backup_to_tar_lzma test_backup_restore_s3/test.py::test_backup_to_tar_xz test_backup_restore_s3/test.py::test_backup_to_tar_zst test_backup_restore_s3/test.py::test_backup_to_zip 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[False-True-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-False-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-False]' 'test_backup_restore_s3/test.py::test_backup_with_fs_cache[True-True-True]' test_backup_restore_s3/test.py::test_incremental_backup_append_table_def test_backup_restore_s3/test.py::test_user_specific_auth -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 ' returned non-zero exit status 1.